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METHOD AND SYSTEM FOR MULTIMEDIA MESSAGE SERVICE 
COMMUNICATION 
Tedmicalfldd 

The presait invendon gsneraSly idales to the comnamicalion technology, and in particular 
to an interactive method, a user tenTrin^l and a cornmunication q^stan used for m ultime d i a message 
services. 

Background Art 

As an attractive value-added service* flie short message service (SMS) is increasingly 
beconni^ another important service area in moUle cornmunication netwodcs involved voice service >» 
as a leading fiinctioa A wide range of diflSarentvalue-a^ S 

o 

mobile data communication means of short message such as mobile phone bank, mobile phone ^ 

securities, infonnalion on-demand, wireless e-mail, wireless data communication and£ax etc. All m 

these are refraed to as "short message service" (or SMS) in gotieral. ^ 

At present, SMS is a fairly basic data service that enables a wirdess subscribe to send ^ 

15 siriq)le text rnessages of up to 160 chaiactera at the present SMS h^ ^ 

devdopriient in commuincation, been devdopedfcom a sinqple notification means to a versatile fy 

CD 

platform for value-added services. 

Taking fig.l for exauDple^ whw a conventional solution is shown for SMS based 
value-added services adopted for wireless subscribers. For example, if a usa- wants to ask for a 

20 current stock quote of IBM via SMS, he or she has to find flie IBM stock quote service code (SQ) 
and the service provider access number (Le. message center number, e.g. 123456), and input the 
command format (i.e. the service code plus the conq>any name: SQIBM), then smds this to a 
message center to request the desired inforrnation about the stodc quote of IBM. Upon receiving a 
request from a subscriber, flie message cent^ (or netovork server) provides the content requested 

25 by the subscriber in response. Althou^ it is very troublesome to ranember and input the contents 
relating to this kind of requests, the SMS based vakie-added sepAce gives users fiie convenience to 
access and to acquire information. 

Because the current diort message service siqjports mainly relatively short texts, the future 
development in contaits of the short messagps will be focused on multimedia contents. The most 

3 0 prominent feature of this kind of lid^r short message service, however, is to siqiport m ultimedia 
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messages to pass qq video cHps, pictmes, audio samples and text Multimedia message service 
(MMS) has beea prqposed in consequiM^ 

MMS is ttie natural evolution of SMS. Hie messaging standard for MMS is set up by two 
dganizations, WAP O^toless Application Protocol) Forum and 3GPP (3«^ Gmoation PartuCTsh?) 

5 Project), Therefore MMS is designed to oporate at upper levels of flie WAP protocol, without 
limitation to a certain art of transmission, supporting both the drcmt-switched data communis 
and flie general pacJoed radio sovice (GPRS) data communication. MMS currenfly adopts 
WAP-push techruque, which is a store & transniit function anoilar to that of SMS, and tiierrfore the 
cuDtentMMS technique remains yet a store/transmit one. This means fliatif amessjigp is sent by a 
10 handset a redpifimt will not i»cdve it diiectiy.histe^ 

by a multimedia message center of the netwodc in which the subscriber resides, and flien flie 
multimedia message center sends a notification to the recipient informing that the recipient should 
download the message fiom the multimedia message ceatsx. A similar multimedia message ceater 
exists also in SMS systems, but as all tiie messages to be sent are text ones, it is relatively simple in 

1 5 operation. Wheieas by MMS, the op^tion in flie message center is relatively complex as it will 
not rely on a certain networkof a certain operator, so if, for example, the recipient resides on a 
slower network, or his/her handset* s screen has a differrat size, the equipment at flie qperator 
needs to be able to delect flie situations and to configure a corresponding message format 

MMS is a new global message communication standard, the most prominent feature of 

20 which is flie supporting of multimedia plications. The multimedia message enables contents and 
pieces of infonnation wifli a ML tmg^ of fianctions, including images, audio infiDrmation, video 
information, data and text, to be transferred, and video cKps, pictures, voice and text, supported by 
a GPE5S network, to be transfecred, by takiiig advantage of WAP protocol as a carrier. When flie 
MMS specification was constituted by flie standard organization it was once conceived fliat MMS 

25 should be an applications bearing platform serving not only as a store-forward center for messages 
but performing various enriched applications. Through a mobile terminal siqjpoated by MMS a user 
should enjoy flie same content services and experiences, as he or she would get flirough flie 
classical Internet As MMS can support a wide range of data format standards, such as image 
format, audio format, animation format standard, fliat entirely flie same expedence as get &om flie 

3 0 intemet is flaeref or deared to be available for user by MMS , or even multimedia data stream 
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stgppoit is expected, whm, in futum band width allows to greatly enhanoe the message 
expiession capability and eondli message contents. MMS promises a dramatic inoease in 
mfvs^ging capabilities that will CTiich user e^qperirace and create a m^or new sonioe of levenne for 
netwodc operators as well as content and service providers. However, a primary shortcoming or 
5 impeacfiection of fee current MMS standani is that MMS is stifl in a situation of "sin5)le 
commimication", that is to say, most of the short message services available at present are 
unidiiectional, generally do not provide interaction between contmt sources or provides and end 
users. Alfeougih some features of interaction between rad users and servers (or content and/or 
service provider) have been proposed, involved only in those features that amobfle subscriber 

1 0 send a message wifli a mobile terminal to reply a infixnmation request, which do not satisfy real time 
danands for information interaction ficom users, and tins feet limits flbe development of flie 
value-added MMS services. 

MMS is the natural evolution of SMS. Because MMS delivers much richer contmt than 
SMS, MMS provides a fiiendly and vivid method for expression. However, the service model 

1 5 uiherits fiom the MMS, and users have to compile the request message by themselves. And 

currently most of MMS jjiplications only focus on how to transmit and presmt images, ring tones 
and text, but do not talk about how to make full use of MMS characteristics to enhance the user 
e;q)erience in MMS value added services. Espedally in most of MMS plications, attention is 
scarcely paid to provide or improve interaction services between end us^s and servers (e.g. MMS 

2 0 providing servers) and to aim at a MMS available on a server, and a more meaningful local 
interaction at users mobile tenninal is impossible. For example, an associated operation on 
individual information items in a received multimedia message is not realizable. The contents of 
mnitimftrtifl message that can be displayed on a user terminal are limited and, the user needs eittier 
by repeating many tinaes of operations or opmting on flie message displayed to get a further 

25 infbraiation, or by con5)iling request message and smding the message thus conq^osed to the ser^^ 
to get more information. Needless to say, it is not only that the message contents that a user can get 
are limited, but that the procedure a user must lake is boring and troublesome, all of tiiese reduce 
the experiences a user get in multimedia messa^ 

As it is shown in Rgure 2, where a MMS structure is shrqply illustrated, a multimedia 

30 message consists of MMS headas and a message body. The MMS headers contain such 
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ipfgnnation on how to tramfM- th^ mnlriTYiMtia itiessagR fmm an cmgiiial to a. tecq^ieiiL as an oiigiDal 
addiess, destinalion address and etc. The message body consists of several parts including 
multimedia olgects, such as imagp (jpeg fonnat), tect (plain format), audio (wav fiHmat), each in 
separate part, as well as the optional preseutalion part The presentation part contains instructions 
5 to explain how the mnltimftrtia contHit shouMbe lendeasxL In the prior art feere are various 

alteanatives of the con^uter presentation language* which deals witii how to display presentations. 
One of tiiexn^esmtation languages mostly used by those sidlledin the art is Synchronized 
Multimedia Iht^cationl^guagp (SMIL). SNflLisacomnumdeploynientfiorMMSpresmtadoi^ 
It is anin^rtant way to integrate multixnedia into Web content SMIL is an ex.tmdible maikqp 

10 language (XML) based language. The XML language allows to descnbe timing indicated by 

mnltimftftifl^ to associate supper-links wifli multimedia objects and to define the layout presented on 
the screea SMIL is regarded as a way for enriching of the current text message based tc^^ 
technologies. SMIL consists of a set of modules that define the semantics and syntax for cartaia 
areas of functionality. These modules are layout module, timing and synchronization module and 

15 animation module. SMIL merely describes how to show amessage on a screen, but it does not 
provide any interactive features for end users. So the SMIL needs to be extended to support 
int^sctive presentation, because interactive messagies can provide good user expmence to 
popularize the MMS technology to wider application areas. 

Anotherpresentationlanguagemostly used by those skilled in the art is Hypertext Markup 

2 0 Language (ETTML). The HTML is the most popular language si^jporting interactive presentation in 
Web applications. But the HTML form (a form presenting as a HTML document) cannot be \ised 
in MMS, because the HTML form cannot separate the content fsvm the presentation, in otha: 
words, in a HTML form ttie presmtation is often mixed with the data. As matter of feet, there are 
so many MMS clients wifli quite different capabilities, and flie separation betweea the content and 

25 the presentation would make it posable to support difiBerent MMS clients. This is a basic 

requirement for a MMS message presentation language. Furfliermore, the protocol adopted in the 
network service program, for example flie communication model of Hypertext Markup Language 
(HTML), is request/response. Ihis model leads to more round trips between the service and the 
cKenf s molale terminaL MMGS is a message system, which runs over vwde-area wireless networic It 

30 is not a real-time message. If the requeslAesponse model could be implemmted, the round-trip will 
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bdnghi]^ latency and reduce fhepescfotmance of Ihe v^hole system. What is needed is to display a 
licherd^iianiicfiQimiQanoptk^^ client's tenxdnaL 

Disdi^are of the Invention 

In view of the above problems in the prior art the aim of the present invaition theiefoie is 
5 to provide an interactive mefeod for multimedia messigp services. 

An object of one or nuHe embodiments of the present invention is to realize an interactive 
mnitimpftift communication between subscribeiis and a MMS back aid system, for exanq^le a 
multimedia message providing server, preferably in ieqK>nse to an piece of multimecfia message 
from a server a response message is generated automatically to be sent baick to the server without a 
1 0 multiple round-trips between the user terminal and the server, and according to the present 
invention a flexible, richer and more conveniCTt local int^action at user terminal is possible. 

Another object of one or more embodiments of the preseait invention is to provide an 
optiinized user int^fece of the MMS message for users. To this aid one or more interactive 
controllers are embedded into the multimedia message, the user performs the local inteaction of the 
1 5 user tmninal as well as the interaction betv/em flae user terminal and ftie server (for example a 
multimedia message sliding server). 

Yet anottier object of an embodiment of the present invention is to create a dynamic Web 
form, which is displayed on the user terminal, m XFonns language, preferably a plurality of dynanric 
forms included in an single message presaiting page to provide ridia: interactive presentations and 
2 0 more optimized multimedia messages for the user, to enhance his or her experience. 

According to the presmt inv^tion an interactive method for multimedia message services 
is provided, conpdsing steps of. receiving a multimedia message fiom a serv^, snouting apage 
displaying orplaying the multimedia rnessage at a user terminal, wherein one or more controllers are 
ernbedded into the dispkyed or played multirriedia message and associatio said 
25 controllers are defined; and triggering at least one action event and performii^ a corresponding 
action in response to the operations of one or more controllers. 

In one embodiment, said triggered action event is to send back a response message to the 
server which renders said multimedia messa^ and in response to the operation of said controllers, 
automatically gena:ating a response message for request to submit an order. 
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Iq ano&er exsbodinieiit, said tiiggeied action event is to modify tbie content of said 
multimedia message; and in lesponse to tlie operation of said conlzollers, diq)layiDg or playing said 
modified content of said multimedia messagie. 

In another anbodinient, the stq) of gaierating ttie page for displaying or playing a 
multimedia tnessage further includes: jwrsing the received multimedia messa^ to obtain the 
presentation stmctuie of said multimedia noessage; and generating a data model used in the page for 
displaying or playing Turnlrimftdia meRgage^hasftd on Raid m ulrimftdia mess^ preasntalion 
structure. 

Aocoiding to another ^speci of tbe present iirvention> a user terminal for multimedia 
message service is provided, adopted to receive multimedia message from a sever and process said 

rn^iltirpftHia mfiss^gp^ nyr terminql mmprisftR! a dfivirft fnr TiBceivmg m ultimftdia messag e fiiom a 

server, a device for generating a page for displaying or playing said multimedia message; a device 
for embedding one or more controllers, between whic±L relationships are defined, into said 
dispkyedorpkyedrnuMniediarnessag^and a device for togging at least one action event in 
response to an opoiition of said one or more controllers, and for iaoplemaiting the corresponding 
action. 

According to yet anotiiear aspect of the present invention, a communication system for 
multimedia message soidce is provide, said ^stem comprising: one or more user terruinals; one or 
more servers for sending a multimedia message to said usa: terminals, characterized in that said user 
tftiminal comprises: a device for receiving a multimedia message from a server; a device for 
generating a page for displaying or playing said multimedia messa^; a device for embedding one or 
more controUecs, between which relationships are defined, into said displayed or played multimedia 
noessage; and a device for trigging at least one action evait in response to an operation of said one 
or more controllers, and for performing the corresponding action. 

The interactive approach for the multimedia message service according to the present 
invention, the user terminal and corresponding communication system as well as the corresponding 
computer program provide a method for generating the value-added message based message for 
multimedia messa^ providers, a jGriendly user interGace^ which enables amore vivid dynamic form 
to be presrated in an optimum rnann^, for the MMS user, and a more convenient way to send a 
service request for the MMS user. According to tiie present invention tiie user can access more 
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inf Qimation ^hile the iound-trq» betwem the server and fhe user mobile tenxdnal are reduced 
wi&out taldbg i3p too many system 
thepeifomiance of &e message service system is improved. 
Brief Description of the Drawings 
5 EmbodimQits of ttie invention wfll now be described, by way of example only, and witii 

lefercnoe to the following drawiags: 

Pigiiie 1 schematically RhnwR a SMS interfiace presented on a user temiinal; 
Hguie 2 sdimiatically shows the message structme of conventional multimedia message; 
Hguie 3 schematically shows a block diagram of a MMS co mmu nication system 
^i^loying the method of an embodimmt of the present invention; 

Rguie 4 schematicaUy shows die mtBcactive procedure for die multimedia message service 
according to an embodiment of the present invmtion; 

Figure 5 schematically shows the flow chart of the procedures of the interactive method 
for the mnitimftHift message service according to an anbodirQent of fhe present invention; 

Hgure 6 shows logic models of die interactiye controller according to an embodiment of 
die present invention; 

Rguie 7 shows one of fhe controlla:s according to an embodiment of fhe preset 
invention; 

Figure 8 schematically shows an exarrple of fhe interactive multimedia message service 
irnplemented according to an raobodimmt of die present invention; 

Figure 9 schematically shows a data model of fhe multimedia message according to an 
^nbodiment of die present invention; 

Hguie 1 0 schanatically shows a data model of an exanplary multimedia message 
iflustrated in a riiefhod for realizing die int^:activeapp^ and 
Hgure 11 scfamiatically shows a functioiial diagram illustratirig an middleware process 
according to the present mefliod, 
Mode(s) for carrying out the Invention 

Heceafier a detailed description will be gjtvm to embodiaients of fhe preset invention wifli 
lefieronce to accoooqpansdng drawings. It should be understood that flie following descrq)tion enables 
those skQled in the art to cany out presoit invention. Various changes and modifications will 
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become apparmt to those skilled in ibe axt, and fhe teachings of the present invention can be 
ajqpliedtooflierembodimQits. Tbepiesmt invention is thercfoie not intmded Id be liioit^ 
^cimipteiy embodinients descnbed bdow. 

Reference is now tsksa to Hgure 3 which sdiematically shows a block diagram of a 
5 MMS conimunication system. The MMS communication system is adopted ftie 
interactive multimedia message, realizing communicalion between a user mobile terminal and a 
server^ for example a multimedia message server. AMMScoiimiunicationsystmLgensially 
corcqprisesofthree main parts: a MMS value-added sendee server 300, a communication netwoak 
and MMS cent^ (MMSQ 2(X)» and one or more MMS terminals 100. The value-added service 
server 300 provides and sends multimedia message, and can receive lequest in message form from 
ftie MMS tenninal 100. Preferably MMS value-added service serve 300 may comprise a 
communication module 301, a message parser module 302, and one or more service module 303. 
The communication module 301 is adopted to process various possible communication protocols, 
for example HTTP or SMTP- The message parser module 302 parses incoming request messa^, 
for example^ fix>m the MMS temoinal 100 to doive die format and content of messa^ to be 
piesented, according to die association inf conation contaiaed in the message header, fiom the 
received message, and then passes the request message to a corresponding service modules 303. 
Ihe s^ce modules 303 are used to process the service logjc* The communication network and 
MMSC 200 can be provided by suitable communication operator. The MMS terminal 100 may be 
any communication device, wMdi allows multimedia message communication, either an individual 
mnltimpi^ifl corumoinication device or various other communication devices which have the capability 
of carrying out multimedia message commurdcalion, and the corresponding hardware structure^ the 
MMS terminal includes but is not limited to a mobile telephone, a personal digital assistant (PDA) 
and etc In g^eral, theMMS tem:iinal 100 conqprises a MMS module 110 for carrying out the 
multimedia user application program on the MMS terminal 100. Through running the multimedia 
user application program on the MMS tenninal 100, fhe local interaction on fhe MMS terminal 100 
and the interaction between MMS traninal 100 and fhe servo: 300 are realized. Preferably, fhe 
MMS tmninal 100 includes at least four compon^ts: a communication module 11 1, a parser 
module 1 12; an interactive module 1 13, and a storage module 1 14 Wb^nein die communication 
module 111 mainly process various MMS communication protocols so as to communicate with fhe 
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searver 300 via fee MMSC 200. The parser moduLs 112 parses flie mnlliniedla messagfi received 
fiom file server, reads out the information in respect to the messagp format to be presented on the 
MMS terminal 100 and ttie related infcmialion, so as to carry out corcesponding process on ttie 
message of various presentation format Should, for example the received message format be 
pictorial a picture information is displayed according to the picture message format; an audio one, 
an audio message is played; and a textual one, the content of a text is displayed The interactive 
module 113 candes out ttie associated operations corresponding with individual controllers listed in 
the miiltiTYiftdia message form, accotding to flierelationsh^ between the media objects, whichbave 
been parsed fix)mttie received multimedia message, to realize fiie local interaction on the MMS 
terminal lOOandfteinteractionbetvvreenMMS termmal lOOandttiese^ 
module 1 14 is used to store the received message and involved process results therewith. 

Now refearence is taken to Figure 4 Rgure 4 schematically shows the interactive 
procedure for the multimedia message service according to an embodiment of the preset invaitiorL 
Rrstly, in procedure 1 30 the s^er 300 sends an interactive multimedia message to the MMS 
terminal 100 via a communication netwods: and a MMSC 200. The message is, for example, sent 
once and m£^ be permanently stored into the MMS temmnal 100. 

In procedure 120, a process of a local interaction on the MMS terminal 100 is showiL 
The local interaction process is a process that deals mainly with user operations, namely tiiat flie 
uso* performs operations, including adding, deleting, modifying, entering, selecting, searching and 
etc, on various fonns provided on the user interface. Of course the user can either choose one or 
more from said operations, or pecf omi none of them. 

Depending on the reguhement, an interaction between a MMS terminal and a serv^ is 
also realizable. In procedure 131, a request message concpismg request message itq>utted or 
chosen by the user, is sent finom MMS tenninals 100 to service server. Preferably, aiesponse 
message with the deshed service is sent back (procedure 132) to the server 300. 

Hereafter, the interactive approach for multiinedia message service is fhrflierCT^ 
details with reference to Figure 5. 

Figure 5 schematically shows the flow chart of the procedures of the interactive approach 
for the nuiltimedia message service of an ^bodiment of the present inventiort Tb^ procedure steps 
illustrated in tiie flow diart are maiiily performed through a MMS module assembly 110 in the 



wo 2004/107688 



PCT/EP2004/050874 



10 

abo ve-inmtiQDed MMS tenxiinal 100, that is ftM fhe piesmt embodiinmt is realized ttuou^ 
pecformmg &e us^ application program, which runs on fhe MMS module assembly 1 10, in die 
ccmmunication module 111, the parser module 112 and ^ interactive module 113. Of course the 
descr^tion of flie embodunent is only given in an iUustrative mauner, and the present invention is not 
limitedto the structures shown in the accon^anying drawings. 

Now refisanence is taken to figure 5. In view of the naultimedia messige (PI) ficomfhe 
mnltimprfia magfiflgp. servfir ^00, in Rtep F2, the multimedia message ir necgrved hy the MMS 
terminal 100 via MMSC200. I^rsdy, parser module 1 12 parses the presentation portion (P2) of fhe 
message out of the recdved messagp data. The pcesmtadon portion (P2) is £nequimtLy involved in 
the message content to be presented Next, in connection with flie presentation portion (P2) of the 
messagp, the presentation portion is furflier parsed in step F2, that is, an analysis is carried out in 
respect of the desaiption about how to display the message. The presentation structure (PS) of the 
presented message, acquired flieieficom, is the related message format to be presented on the 
MMS temdnaL Besides, while paramg of fhe presentation portion of fhe messa^ is carried out, the 
rules of relationship and activities between controliers is parsed and then the relationslqp and 
activities are embedded in an action form 0P8). Based on fhe parsed presentation structure (P3), in 
step F3, a data model (P4) of fhe presentation message or display message is created according to 
different message formats, such as a text format, an audio format, or a message format, which is 
preferably displayed in a Maikup language. In view of the created data model (P4) for displaying 
or playing message, corresponding data are loaded and a message page (P5) is created in step F4. 
In step F5, the created message page is displayed or played on the MMS terminal 100. In view of 
fhe presented multimedia message the us^ performs op^tion on it, and in step F6 in response to a 
user operation an action event (FT) is created And in step F8, an action listener is used to monitor 
fhe action ev^t (P7), the action event is processed and a conesponding action is graerated The 
action listener is, in step 7 , generated based on an action list defined for regulation regulations, 
resulted from fhe parsing of the presentation portion performed in step 2. In stqp 9, in view of the 
action (P7) monitored in step F8, an event-processiag program is activated to process flie user's 
action. The monitored actions are, for example, divided into two kinds, one is to dhange the 
contents (PIO) on the message pag^ on the MMS temdnaL For this kmd of action, step F5 is 
repeated, that is, theactionisprocessedontiiebasisof the action rules defined in fhe action list, so 
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as to display c»: play tibe dianged message pag^ on tiie MMS tertninal 100. Ibe oSossx is involved in 
the interaction vnSx the servioe^ in sbsp FIO, on flie basis of ttienew messagp model and fteielaied 
data, if the event is an ev^t involved in message delivery, a message is gmerated in aoxndance 
with the message modd and liie usa:^s poD^rence and liie^ 
5 300. 

According to an embodiment of the present invention, when the MMS presentation model 
is created one or more interactive controllers are provided on a multimedia message presentadon 
intet&ce in whidinunib^ of forrns are provided The intei^ cmtroUers may be an submit 
button for an order f orm» a radio button, a check box, a text, a text field, a list box, an option menu 
and etc. Eachof the controllers can be designated a name. When aformis submitted, the name and 
current value of a specific controller can be sent togeflier with the fyroL By erribedding controllers 
into the multimedia message, the user can express his or ho* pief^ence to the service application 
program by means of these interactive controllers, to provide an interactive solution. 

Now the reference is made to figure 6, which shows logic modules of the interactive 
controllers according to an CTOLbodimmt of the present invention. 

The present embodimait seaports multimedia itimis throu^ut extending interactive 
controllers. The si^ortedrrnjltunediait^nsrnay be irnage, audio 

button, the check box, die list box and the option menu may be pictures, audio and video clips. 
Takm the option menu for example, the items of the option menu could be pictures. Each picture 
represents an itCTOu Take fee multimedia options menu shown in Figure 7 as an GKmspie. In Hgure 7 
models of Nokia handsets, for example Nokia2110, NokiaSllO, Nokia6110, Nokia7250 etc and 
pictures of the respective models of handsets are illustraled The user can, for example, chdc a 
handset picture for one of the various models, and the handset of this model is displayed on die 
display screen of die user terminal, MMS terminal 100. The us^ can also move die slide box to 
display more Nokia models of handsets and pictures. 

Hereafter descriptions wiU be given to the relationship between the int^ctive controllers 
proposed by an embodinent of the present inv^tion. Logic modules are adopted to define 
relationships and actions. The relationship between the iateractive controllers includes two kinds of 
relationships, namely LINK and CONTAIN. For example, if a LINK relationship exists between 
two or more interactive controllers, when one of the controller items is selected, aU of others are 
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sdected too. Gonsequioilly , ^ben one of tbe controller items is displayed, all of ottiecs aie 
displayed or played too. As it is shown inRgute 6, whrai the model of a handset is changed from 
Nolda 5100 to Nolda72S0, for eveiy model of handsets their pictures andpnces aie chax^jgd in 
consequCTt respectively. CONTAIN is another lelationsMp. Fbrexan^ 1 of die 

5 controller A contains items 1 flirough 7 of die conttoUCTB, when itsoi 1 of flie controller A is 
selected, only items 1 ftirou^ 7 of the controller B can be selected 

According to an oBbodiment of the presait invimtion, fiisfly the existing MMS syston is 
eTCtended to display a richer dynamic form on tiie wer fprrmm}^ wherein the displayed individual 
controllers have certain assodation, preferably the relationship betwera controllers are defined as 

10 LINKielations or CONTAIN relations, to facilitate tiie user to operate on tibe displayed 

TfiylfimftrKfl cQjessa^, such that a convenient means for the interaction between tiie subscriber and 
the back end systems is provided A user can select and input his orherprefearence by means of 
these interactive controllers, and the interactive controllers designed according to the presait 
invaition can automatically generate a response message based on the user's choice. The user 

1 5 pushes the order form submit button, and a response message is generated and sent out For 
exarqple, a response message, which contains an order request Le. an order form, is generated 
automatically, and sent to the server. A common solution is provided to message servers/users to 
g^erate/operate on value added services by means of ext^ding die MMS system. A very fiimdly 
usCT interface of the MMS message is provided to the user by means of using tiiese interactive 

2 0 controllers. When the user selects diffenmt parameters, the message is displayed with a different 
presentation structure. In this manner, the user can accomplish a local interaction or an interaction 
witii a message server. 

The extending of the existing MI^ system acc(Hding to an ^bodim^ of the present 
invention is realized by embedding XFonns technology into MMS presmtation language. The 

25 current MMS standard is extmded to enhance tiie interaction capability for the MMS message. 

The XFoims is extended to support the multimedia interactive controllers. The relationship between 
the controllers is described by means of a XML based document For example, the relation 
description is named Relationship XML (EIXML). And a MMS middleware system is introduced 
to process the interactive noultiniedia rnessage service. 
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XFbrms is an XML-based language wbich (Mines f onn-based interaction inteifeces. 
XFonns is a renewal of &e HTML fonn con^osed in flie HTML language. XForms provides an 
extendable noetfaod to contain ddier and moie dynamic forms in the HTML file. By flitting a 
conventional HTML fomi into ttnee parts, namely data model, exemplary data and user intei£u:e. 
5 The presoitation is s^arated iiom die content, so a multiplex is allowed and more powerful ir^ut 
function is available. XForms and XMIL are all XML based languages. XFonns can be integrated 
into SMEL XFbrms provides various kinds of interacdve contm]!^ including a submit button, a 
radio button, a check box, a text, a text field, a list box, an qption tDeaa and etc. 

lliese interactive controllers axe ext^ided to si^port multimedia related objects. The 
present embodiment supports multimedia itenns through extaiding interactive controlleis. The 
multimedia objects that can be supported, for example, may be pictures, audio and video clips. The 
items of the radio button, the check box, the list box and the option menu may be pictures, audio 
and video clips. Taking the option menu for example, an iti^ of the menu is a picture. Each picture 
represents an item. 

The relationship between tibe interacdve controllers is described in XML language. 
According to an ^bodimmt of the present invention the relationships betwera ttie xnteractive 
controllers are defined as two kinds of relationships. They axe LINK and CONTAIN relations. 
The most commonly used relation is die LINK relation. For exanq)te, if tfaeae is a LINK 
relationship between two or more interactive controllers, when one of the controller items is 
selected all die other are selected too. Consequentiy, when one of the controller items is displayed 
all die rest items axe displayed or played at the same time. CONTAIN means that, if the item 1 of 
die controller A comprises items 1 through? of die controller B, when it^ 1 of die controller Ais 
selected, only items 1 throng? of the controU^B are selected 

Hereafter die relationships between the controllers are furtiier explained by means of 
examples. 

Taking motorcycle shopping for an exarriple, when a user receives a motorcycle 
promotion message (refer to Figure 8, motorcycle promotion interactive message) and is interested 
in buying one. The user can preview the pictures andpdces (LINK relationship) of difibnent kinds 
of motorc^les simultaneously by &jxxpld select from the model options menu. In other words, as the 
user chooses a model of a motor the jncture and the corresponding price are displayed in 
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(xuisequeoL Roliiennoie, if a user w aats to buy a modd of motoicyde, a Buggy for exatx^le, what 

he ceeds is ooly to sdect be modd aiid dic^ 

fQnn)asweIL 

Hguie 9 sdiematicany shows a data model of an etDbodiineiit of Oe piesent invention. 
5 Wharein, the object 1 is included in flie object 2. The object 1 and tihe object 3 have an ally 
relationship. The attribute of ttie object 1 define tiiose of the object 2. If the object 1 is changed 
from one condition to another, for example the attribute 1 changes, the object 2 and 3 are changed 
inconsequeixe. 

Hguie lOsdienmticaUy showsadatanaoddof anexanq)leofnQiotc»^^ 
portion of presentation stmctme, flie data modd of fiie message shows fi^ve options including motor, 
models, and types of the wheds, pictures, prices and order form submit buttons of bicycles. 
Generally, instance data gives actual data on die basis of a data model Two pieces of message may 
have the same data modd but difGaent instance data. In Rgure 1 1 , the instance data is information 
about motorcycle promotion. The user interface d^uoes the position, format and size of the 
individual itmis. 

Relationship or action portion describes tiie relationship between the object and ttie action 
at the time an event takes place. Usually a message comprises information about one or more 
objects no matter how to preset the information. Relationsh^ or action portion describes the 
internal relationship between data and the internal relationship between the attributes. For example, 
one attribute is defined by otha- attributes or other attributes are defined by one attribute. There are 
also e^^temal relationships betweai the objects. 

For example, in the relationshq)/action portion, the relationshq) between motor, models, 
pictures, prices and types of the wheds of bicycles is shown in Rgure 10. Motorcycle types have a 
group of models; therefor motorcycle objects include model objects. When a type of motorcycle is 
selected, modds that belong to this type can be presmted in the type option menu of this type 
(CONTAIN relationship). Each motorcycle model correspondents to a respective picture. But 
flieie are some types of wheels available for users as options. Wh^ a user pushes the order form 
submit button, a response message is composed by the MMS client application. The response 
message is generated on the basis of the push action. 
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To provide a fiieadly interaction feature so as to &xxicti llie user es^eri^ice of the MMS 

vak^-added service, in an embodiment of fliepiesoit invention, it is adueved by desccibing flie 

service esqnss^on in eaOended XM^ langu^ 

<?xml versiott="1.0'* encodings *ISO-8859-r'?> 
5 <smilxmln^*littp*y/ww.w3.oii^()01/SMnL^^ 
xmhs: xfi]i= 'htlp"y/vvww.w3.org/20(XV01^ 
<xfiii: model i4= *TQmaJL"> 
<xfiacK subnufEofi) id=* W)mit 1" method2= *i)OStxmriocalfile= *tea5>jaiil" 
target2?= http://wwwjbnaucom/motODromote/' '^ 
//attention A 

<xfin: instance xmh^**'^ 
<moto> 

<motox/moto> 
<modelx/model> 
<wlieelx/wheel> 
</moto> 
<6dGD[idnsta]3ce> 
</xfrnmiode1> 
<body> 

<pex iegion=*^preference'^ 
<xfiaxoptionm£!aa le^'^oto*^ 
<xj6n: caption>l. Select the moto</xfiii:caption> 
<x6]idt)raix>Buggy^c£tndtaa3> 
</xfin: qption> 

<xftn: oi^omnmu ie6=*teoderi> 
<xfin: caption>2.Select the modd</x£m: cq)tion> 
<xficn: itGn>Naniial<yxfiiriten£> 
ocfln: itjrai>Model A</xfiiidtea^ 
<xfin: item> Model B<6cfindtBm> 
</xfin: oplioi3> 

<xficn: qptionmenuro&=*S?vheeri> 
<xfin: caption>3,Select the wheels<^xfim: caption> 
<xfin: item>Nom3aI<^^^ 
<xfin: iteDi>Bhhai:K;ed</?E^^ 
<yxfin: option > 
</par> 

<par region="submit*'i> 
<xftn:submit name="submit" ie&=*bioto" to=*W)mitl'S 

<xfiiK cs^tLon>Subn]it</xfin: caption> 
</xfai: submit > 
</pai> 

//the img te^on to display the motor pictuie 
<par legion^'^^Rj^joif' dur= *1ndeBmtB?y> 
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//attention B 

<x6ii: optionmain model=" picture?' lefe" picture*^ 

<xfsn: c£5)tioi]> <^xfiii:c^tiou> 

<xfin: iteiDbuggy .jpg<yk^^ 
5 <xfin: itatio buggy, Ajpg <fafmntpm> 

<xfiQi: itenQ> buggy_B.jpg </x&Qitsm> 
<6c£tn: optiQn> 

<x&ii: optionniffliuie&=*^ce'!> 
<xfiii: capHoro </jcftn: c^tion> 
10 <xfin: itmi>$1250</xfi3Litm)> 

<xfin: item>$1350<6cfimit]Qm> 
<xfi3i: itraD>$1399</jrifiirileir£> 
<xfiii: option > 
</pai> 
15 </bod.y> 

< Agmih> 

13ie irndtmedia message sendee prc^ 

message user intarfiace. The intmctive controllers aie presmted by XFomas. When a MMS 

terminal client receives the message, the presentation is parsed and rendered to display the 

2 0 interactive motorc?ycle promotion message, which looks like Figure 8, For example, the s«itence 

"Attention A" shows a response message format When a user pushes the submit button, a 

response message is con^osed by MMS climt apphcalioa The response message is as following. 

<?xml version="l,0" encodings ^ISO-8859-r'?> 
<moto> 

25 <moto>Buggy<:Anoto> 

<modd>Noormal</cnodel> 
<wheel> Normal </wheel> 
</moto> 
</?unl> 

30 In addition, the important feature of the q^lication is flie multimedia qpljon moiu, which 

shows the picture of the motors. The attention B in the sentences shows the presentation of 
multimedia interactive controllers. 

Aaother important feature of ftie application is link relationship between controUa: 
modules. In this exetnplaiy embodiment description is given to the LINK relationship between 

35 controU^ of modeU picture and price. When the usct chooses a model horn (Select the model) 
option menu, the cocresponding picture and price of this model display at the sanae time. The 
CONTAIN relationship is disclosed in tiie motor collection and tiie modds. If the collection of a 
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certain motor is selected, aH models of ftie motoccycle collection can be seen in die following option 

menu* All other models, which do not bebng to this mototcyde coUectLon, can not be seen. The 

RXML and fhe miitimpdi^ conHoUer items aie shown in ttie following XML document 

//ihe relational XML descaibe the lelation between the controllers 
5 //dielink]?&lation 
//attention C 

<relation name='telation 1" 
<rxml: lijDk> 
<item attD=^icfin: optiomnenu ie;&=*^odeF':> 
<itmi attr=^xfin: optiDnmenu modd= 'picture" ie6=*^ctuie*b> 
<item attp=xfiii: optionmenu iefr= '^ce"i> 
</Txint Hnk> 

<^rxml: instant attr=iiQniial> 
<toaiil: instant > 
</celatLon> 
//the contain leladon 
//attmtbn D 

<ielation name=**relation 2'*> 
<txml: contain> 
<itraDi attp==xfin: optionmenu lefc^Vnoto'b^ 
<containxtmi a lti ^ AQ n: optiomBmu r^'^modeF V 
<6xml: contain> 
<^Danl: instant> 
<item a£h?=cdBDOc itMn>Buggy</ itran > 

< containitem altr^ xftn: itmr>NQmMl</ contaimtrai > 

< contaioitem altt^ xfin: itBm>Model A</ containitem > 

< containitem attr= xfin: item>Model B</ containitem > 
<kxihk instant> 

</DBlatLOIl> 

According to an embodiment of the piesmt invention a MMS smdce middleware is 
designed for MMS service providers to push MMS messages to users, and process incoming 
MMS messages, for example from the MMS terminal, to provide value-added service. The sender 
of the message is auflimticated by the authentication module, which uses the user managemoit 
database to verify user. After fhe authentication, fhe message is parsed by a messa^ parser. Then 
fhe message is passed on to the right message service for process via the service inter&ce. When a 
service initiales a messa^, (he message is verified by a push tdg^ and sent out via the MMS 
interface* 
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The user intecGaoe defines the size, f oim« position, show time, movonent of inteaface 
parametears, and the inter&oe defines how toaddtfaedatainstaxicesintottieptesentalionof ftie 
pages. The user into^ace may be uxq)lm3ented with Ul-wares. An Ul-wace means a foim, whidi 
can be displayed and intenictive in a predejfinedmoda See 11 for a teference, flie Ul-waie 
5 shown can be an indq)endent item sudi as text, picture, video, audio, or a fomo. controller like 
button, check box, list box, radio button, option menu, ixxpvit fidi The itmis of the form controller 
can be text, picture, video or audio. The formcontrollCTs have the same interactive capabilities as 
nomaal HTML Fotm controllers or Xforms cQntrollers. In the iniylementation, the specification 
XForms can be used here. The independent items have no redefined inteiiactive capability, but flieir 

1 0 interactive capabiHly can be added in ielati(»)s/acdons part An interface parameter can be shown in 
diverse Ul-wares. For ex^ampie^ an interfiace parameter with multiple^^oice capability can be 
shown in a diedcbox or a list box, because Ihey ace all multipleohoice controllers. The more 
important is, a data model can be rendered into diverse presentation for diverse MMS devices. 

The intouclive capabilities of interface parameters describes whether an interfiace can be 

15 display4>lay/6dil/select, and whether it is of a single-choice or multiple choice. For example^ a 

message can have two kinds of inter&ce parameters. One is text, which can be irqput and modified. 
Ano&eris an audio array. User can select one itemfix)m the array at a time and eadi of die items 
can be played. 

Up to now, the intemcdve ^proach for multimedia message, user terminal and 
2 0 communication system have been described in details by means of ex:CT[5)laiy CTobodiments. It 
should be undea:stood that the preset invention is not limited to the illustrated embodiment 
examples, on the basis of the description of the embodiments of the present invaitlon, those skilled 
in the art can make various modifications and improvements according to the present invention, 
wiftiout departure fcom the spirit and scope of the present invention. 
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